DanceIt: Music-Inspired Dancing Video Synthesis

Close your eyes and listen to music, one can easily imagine an actor dancing rhythmically along with the music. These dance movements are usually made up of you have seen before. In this paper, we propose reproduce such inherent capability human-being within a computer vision system. The proposed system consists three modules. To explore relationship between music movements, cross-modal alignment module that focuses on video clips, accompanied pre-designed learn judge consistency visual features pose sequences acoustic learned model is then used in imagination select sequence for given Such selected from however, discontinuous. solve problem, spatial-temporal develop spatial algorithm based tendency periodicity predict discontinuous fragments. addition, often misaligned beat. further temporal align rhythm dance. Finally, processed synthesize realistic videos module. generated match content Experimental results subjective evaluations show approach perform function generating promising by inputting